A Consensual Linear Opinion Pool
نویسندگان
چکیده
An important question when eliciting opinions from experts is how to aggregate the reported opinions. In this paper, we propose a pooling method to aggregate expert opinions. Intuitively, it works as if the experts were continuously updating their opinions in order to accommodate the expertise of others. Each updated opinion takes the form of a linear opinion pool, where the weight that an expert assigns to a peer’s opinion is inversely related to the distance between their opinions. In other words, experts are assumed to prefer opinions that are close to their own opinions. We prove that such an updating process leads to consensus, i.e., the experts all converge towards the same opinion. Further, we show that if rational experts are rewarded using the quadratic scoring rule, then the assumption that they prefer opinions that are close to their own opinions follows naturally. We empirically demonstrate the efficacy of the proposed method using real-world data.
منابع مشابه
On Irrelevance of Alternatives and Opinion Pooling
We consider the problem of combining k subjective probability distributions for a quantity of interest θ ∈ Θ. Two modified versions of the irrelevance of alternatives axiom are introduced by focusing on the consensual conditional odds, rather than the consensual probabilities. A strong modification of the axiom requires that the consensual odds depend only on the individual odds, while a weak m...
متن کاملAn ordinal characterization of the linear opinion pool
Given a collection of individual ordinal probabilities on a nite state space, we discuss an ordinal condition that is necessary and su¢ cient for an ordinal probability to be represented as a weighted average of probability representations of the individual probabilities. We also give necessary and su¢ cient conditions for when such an ordinal probability can be represented as an unweighted av...
متن کاملA Critical Study of the Well-known Opinion of Shiite Jurists on the Inheritance of a Bastard
According to the well-known opinion of Shiite jurists a child born out of wedlock is prohibited from inheriting from his/her own natural parents. This rule, however, is not among those consensual laws which accept no new rereading. The evidence supporting this law is, basically, some single hadiths (khabar wāhid) which suffer from weakness in terms of authenticity and indication and implication...
متن کاملTesting Ensemble Methods on Prediction of Protein Secondary Structure
The geometric opinion pool (GOP) ensemble method uses a multiplicative combination of predictors, and it is tailored to probability estimation in multi-class problems. This enables a decomposition of the KullbackLeibler entropy error function into an ambiguity term and an average error term. This can be used to estimate generalization error with a combination of cross-validation and estimation ...
متن کاملCombining Probability Forecasts
Linear pooling is by the far the most popular method for combining probability forecasts. However, any nontrivial weighted average of two or more distinct, calibrated probability forecasts is necessarily uncalibrated and lacks sharpness. In view of this, linear pooling requires recalibration, even in the ideal case in which the individual forecasts are calibrated. Toward this end, we propose a ...
متن کامل